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METHOD FOR TRACKING THE SIZE OF A MULTICAST AUDIENCE 

The present invention is concerned with measuring audience size, and especially of estimating the 
size of a dynamically changing audience in multicast transmission. 

One form of multicast is an IP technology that allows for streams of data to be sent efficiently from 
5 one to many destinations. Instead of setting up separate unicast sessions for each destination, 
multicast will replicate packets at router hops where the path to different multicast group members 
diverges. This allows a source to send a single copy of a stream of data, while reaching thousands 
or millions of receivers. In conventional unicast communication the sender sets up a separate 
transmission session for each audience member and can track the size of the audience by counting 
1 0 the number of requested streams in the server log file. In multicast communication the server sets 
up only one stream of data which is sent to a single multicast address, instead of being addressed 
separately to each receiver. Any host that is interested in that stream of data then joins the 
corresponding multicast group and picks up the data stream from its local router. The size of the 
audience is therefore hidden from the sender and could vary rapidly in time. 

1 5 The situation is very similar to conventional radio and TV broadcasting: the radio or TV station 
sends out the programmes to ether and receivers can listen or watch their favourite programme by 
tuning their receivers to the channel over which the programme is sent. 

Tracking the size of multicast groups is technologically important for several applications: 

• Multicast is used for real-time delivery of audio and video streams over the Internet to a very 
20 large audience. The revenue generated from these applications is mainly from advertising and 

depends very much on estimates of the audience size and its variation in time. 

* 

• Multicast is used for large-scale publish- subscribe applications. In these applications 
subscribers register their interest in a topic or a pattern of events and they asynchronously 
receive events matching their interest. By subscribing to a topic the subscriber become a 

25 member of the multicast group corresponding to that topic (e.g. share price of a certain 

company) and receives a notification whenever that topic is updated. The publish-subscribe 
servers can update on a regular basis users' interest in topics (the number of listeners per topic) 
in order to optimise the division of topics and the distribution of them among multicast groups. 

Measurement of the multicast audience size (and other statistics) can be performed on the network 
30 layer. In this approach memory tables are captured from network routers in parallel and are 
transferred to the monitoring unit. The monitoring then extracts the size of the multicast group (and 
other statistics) from these tables (See K. Sarac, K. Almeroth, "Supporting multicast deployment 
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efforts: a survey of tools for multicast monitoring", Journal of High Speed Networks, vol. 9, no 3- 
4, 2000 and P. Rajvaida, K Almeroth and K. Claffy, "A scalable architecture for monitoring and 
visualizing multicast statistics, Proc. of 11 th HFIP/EEEE International Workshop on Distributed 
Systems (DSOM2002), Austin, Texas, USA, December 2000.). 

Three problems with this approach are 

• It requires that the monitoring unit have access to networks multicast routers. A requirement 
which is not feasible in many situations. Furthermore, even if the monitoring unit could access 
the multicast routers, current standards do not require these routers to maintain a count of the 
number of local receivers. 

• It is not applicable to application-level multicast where multicast transmission is built as an 
overlay on top of a network without multicast capability. 

• The method is not scalable to the publish- subscribe scenarios described above, where billions 
of subscribers have subscribed to million of multicast group (due to implosion of information 
at the monitoring unit). 

In the literature a number of solutions have been suggested for the problem of real-time end-to-end 
estimation of audience size for large-scale multicast transmission. Two known technologies are 
the methods suggested by Lieu and Nonnenmacher (C. Lieu and J. Nonnemacher, "Broadcast 
audience estimation", in Proc. of IEEE INFOCOM 2000, Tel Aviv, Israel, March 2000, vol 2, pp 
952-960) for estimating a static audience size, and the method of Alouf, Altaian and Nain ( S. 
Alouf, E. Altaian and P. Nain, "Optimal on-line estimation of the size of a dynamic multicast 
group", 

http://ww-sop.inria.fr/mistral/personnel/Sara.AloufyPublicati Proceedings of 

INFOCOM2002, New York, USA, June 2002) to estimate a dynamically changing audience. Both 
methods are based on random sampling of feedback messages from a group of the audience by the 
sender. From this random sample the size of the audience is then inferred using statistical 
techniques. 

In the Lieu et al method, random sampling is done using a timer-based method (See also J. 
Nonnemacher and E. Biersack, "Scalable feedback for large groups", IEEE/ACM Trans. On 
Networking, vol. 7 no. 3, pp. 375-386, June 1999, and our European patent application 02254355.7 
dated 21 st June 20902 'Timer-based feedback in multicast communication", M. Nekovee and S. 
Olafsson). In this method the sender sends a timer distribution f(t) to all receivers, together with the 
feedback request. Upon receiving the feedback each receiver samples a backoff time from f(t). 
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After expiry of this time, the receiver remains silent if it has detected a feedback message from any 
other receiver, otherwise it sends a feedback to sender 

(And all other receivers), which contains the expiry time of receiver's timer. The sender collects all 
feedback. Using a combination of the feedback count and the expiry times of receivers' timers, the 
receiver makes an statistical estimate of the audience size. To achieve high accuracy in the 
audience estimate this procedure has to be repeated for many rounds since the estimation error 

decreases only as \l 4M where M is the number of rounds. The main technological problems 
with this approach are 

• The estimation procedure works well for a static audience size but is not suitable for a 
dynamically changing audience size. This is because the method requires several rounds of 
feedback collection from the same audience in order to accurately estimate the size and the 
estimate becomes inaccurate when the audience size changes during these collection rounds. 

o The timer-based random sampling from the audience requires that each feedback message 
is send via multicast to all the audience. The overhead to process these messages is small when the 
sample size (i.e. the number of receivers that sends a message at each round) it small and we are 
considering only one multicast group. But the overhead can become large when receivers are on 
several multicast groups at the same time and so will receive feedback messages from all these 
groups. 

• The timer-based mechanism for sampling is biased towards receivers with the smallest 
round-trip time (RTT) to sender since, on average, these receivers are more likely to send a 
feedback messages. This bias reduces the accuracy of the audience size estimates. Also, it makes 
the polling mechanism unfair since receivers with an RTT larger than average are much less likely 
to be " heard" by the sender. 

The method of Alouf, Altman and Nain removes some of these problems by using a simpler 
mechanism for random sampling based on probabilistic multicast (See M. H. Ammar, 
"Probabilistic multicast: Generalising the Multicast Paradigm to Improve Scalability, in Proc. of 
IEEE INFOCOM94, Toronto, Canada, June 1994, pp848-855. ). In this method the sender sends a 
request for feedback to all receivers. Upon receiving the request each receiver sends feedback, or 
not, according to a specified probability Since each receiver decides independently from the rest 
whether to send or not to send a message, the sampling mechanism is not affected by sender- 
receiver and receiver-receiver RTT times and is not biased towards receivers with smaller RTTs. 
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The average number of messages sent is a random variable, which has a Binomial probability 
distribution function (pdf) . Just like the timer-based approach, the sender estimates the audience 

* 

size from the feedback count using well-known statistic estimation techniques. 

The method of Alouf, Altaian and Nain provides a solution for the problem of dynamically 
changing audience size by taking advantage of the statistical dependence between the audience size 
at consecutive feedback rounds, to enhance the accuracy of the instantaneous estimates. This is 
achieved by assuming that (i) the variation of the audience size is described by that of the 
population of a so-called Ml M loo queue in heavy traffic (see Leonard Kleinrock, Queueing 
Systems, Vol I, John Wiley & Sons, New York 1975), (ii) neither feedback requests nor feedback 
messages are lost and (iii) the audience size is small such that there is no risk of feedback 
implosion. 

The technologically remaining problems with this approach are 

o The method does not scale to very large multicast groups, which is the typical situations in 
scenarios we discussed earlier on (Internet and Intranet TV and radio broadcasts, publish- 
subscribe). This is because the response probability is chosen independently of the size of the 
audience and so the average number of feedback messages grows as the audience size 
increases, resulting eventually in feedback implosion, though the possibility is mentioned of 
reducing the probability slightly if the number of acknowledgements becomes too high. 

© The filter parameters are fixed in advance. They do not adapt to possible variations in 
population size and dynamics. 

• The algorithm assumes that neither feedback requests nor feedback messages can be lost in the 
network and is vulnerable in real network scenarios where high packet loss rates could be 
experienced. 

According to the present invention there is provided a method of tracking the size of a multicast 
audience comprising: 

(a) transmitting to receivers receiving the multicast a plurality of requests each including a 
probability parameter, whereby each terminal replies or not with a corresponding probability; 

(b) counting the number of replies to each request; 

(c) determining, from the counts and parameters, estimates of the number of receivers; 

(d) filtering the estimates; 

wherein the method further includes repeatedly computing a new probability parameter to be 
included in a subsequent step (a), by forecasting, from the counts and parameters, a upper bound 
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for the number of receivers and determining therefrom the new probability parameter such that the 
risk that the number of replies exceeds a predefined threshold is kept below a predefined value. 

Other aspects of the invention are defined in the claims. 

Some embodiments of the invention will now be described, with reference to the accompanying 
5 drawings, in which: 

Figure 1 is a schematic diagram of a network; and 

Figure 2 is a flowchart illustrating the operation of one embodiment of the invention. 

Figure 1 shows a multicast arrangement with a server 100 connected via an IP network 102 (such 
as the internet) to a number of receiving terminals 103 (only three of which are shown). The 
10 multicasting operation operates in conventional manner and therefore only the additional 
functionality now proposed for measuring audience size will be described. 

We consider a sender (i.e. the server 100) who is sending messages to a multicast group. Group 
members (103) can join and leave the group at any time. An example is when multicast is used for 
broadcasting TV over the internet. The audience can watch a certain programme by joining the 
15 multicast group corresponding to the channel that broadcasts the programme, and leave the 
multicast group at any time during the programme. 

The measurement process now to be described is implemented by: 

Additional software at the sender to (a) construct and periodically transmit request messages via the 
multicast mechanism, (b) count replies from the terminals and (c) process the results; 

20 and additional software at each terminal to process such requests and generate replies where 
appropriate. The size of the audience is a time-dependent stochastic variable, which we denote 
with N(t) . We assume that sender can handle a maximum number r max of feedback messages per 
feedback round. The aim is to accurately estimate N(t) (and possibly other receiver attributes) in 
real time through feedback counts r(t) from the receivers, while minimising the risk of feedback 

25 implosion (which happens when r(t) exceeds ) at all times. 

The process will now be described with reference to the flowchart shown in Figure 2. 

1. The estimation starts with an initial guess for the maximum audience size N max . 

2. An initial value for the response probability P is then obtained by choosing P as the 
maximum response probability for which the risk for feedback implosion is below a user-defined 
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risk threshold S , given N max . Since the number of feedback messages has a Binomial probability 
distribution function, the probability that the number of feedback messages exceeds r max given a 
population of size N maK is given by 

Pr(r > r max ) = 1 - Pr(r < r max ) = 1 - ^B(N mfDC9 P) = / p (r max + 1, tf max - r max ) 

r=l 

» 

5 and so the maximum possible value of P could be obtained by solving 



Ip(r max +l,N mm -r msK ) = S (1) 



In the above equations, P) is the binomial distribution and I p represents the incomplete 

1 0 Beta function 

i.e. Ip(a,b) = -j — ■ — — 

In the current implementation a version of Newton-Raphson iteration method is used to find P 
numerically from Equation (1). 

3. Once P(t x ) is found the sender multicasts a request for feedback (which contains the 
15 value of P). 

4. Each receiver selects a random number X in the range 0 <, X <> 1 and transmits a feedback 
message only if X <> P(t x ) 

5. The sender collects a total of r feedback messages from this round. 



6. The audience size is then estimated as: 



20 



P(tO 
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Where y is a stochastic estimation error. It is not essential to compute this, but, if required, it is 



proportional to 



(Equation 2, and the corresponding error expression were derived using the well-known maximum 
likelihood method of statistical estimation theory, applied to a Binomial distribution with unknown 

5 parameter N(t) . ) 

Note that the two branches shown in the flowchart are drawn for clarity to show that there are two 
estimation processes operating; they are not alternative paths. 

7. The estimate for the audience size (Equation (2)) contains statistical estimation error 

whose magnitude is inversely proportional to the size of the sampled receivers. We provide a 
10 method for reducing the estimation error in real-time, making use of the available past data. As 
shown, this takes place during the measurement process, after each measurement (see below for 
an alternative implementation). This is achieved by considering the estimation error n(t) as time- 
dependent noise, which is superimposed on the exact value of the audience size N (/) . The signal 
to noise ratio in the measured audience size N(t) = N(t) + n(t) is then maximised by filtering 
15 N(t) with a Wiener filter which provides the best mean-square estimate of the audience 

population. Initially the filter parameters are fixed based on historical information on the audience 

size variations, and the application under consideration (e.g. Internet TV, publish-subscribe etc.) 

but as the audience size measurements progresses, these parameters are periodically re-calculated 

such that they can adapt to the actual pattern of audience size variations. 

20 The improved estimate of the audience size at time t, is obtained from 



= £ KU-tjW^^iP-a)^ #(r,)exp(-/?(f ,-*,)) 

7=1 7=1 

Here 

h(t, -tj) = (P-cc) exp(-^( f< - tj )) 
25 is the optimal Wiener filtering kernel. 



(3) 



(4) 
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The kernel is obtained by making the assumption that the signal ( N(t) ) and the noise (n(t) ) are 
statistically uncorrelated and that the power spectra N P {co) and n P {co) of these can be 
approximated by: 



or + cr 



n P {<o) = A 



(5) 



(6) 



where and ^4 are adjustable parameters , and 



A 



(7) 



10 It follows that this represents a model of the power spectrum iVp of the audience size N{t) for 

* 

which 

ceK 

N p {(d) = ^ (^) + n F {co) = — j- + A (8) 



The above choice for N P {&) is motivated by the fact that the a -> 0 limit of Equation (5) 
15 exactly models a slowly varying audience size, while by increasing a general time- varying 
audiences sizes can be modelled with an accuracy which is sufficient for determination of filter 
parameters. Furthermore, the form assumed for n P {oS) corresponds to the assumption of white 
noise. Our simulation studies show that this is a reasonable estimate of the statistical noise in the 
audience size measurements* 

20 8. Adaptation of the filter parameter ft during the process of audience size measurement is 

«-«■/ 

performed in the following way. The sender accumulates past values of N{t) over a sliding 
window of size M. It then make an estimate of the power spectra of the signal and noise by 
performing a fast-Fourier transform (FFT) on the past values of N{t) (if the data points are not 
evenly distributed the Lomb algorithm is used to evaluate the power spectrum). These spectra are 
25 then fitted to the parameterised form given by Equation (8), using the least-square method, to 
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obtain new values for the parameters K, a and A, from which a new value for the filter 
parameter /? is obtained using Equation (7). 

Note that because the filter kernel h(t) decays exponentially in time it is sufficient in practice to 
accumulate past statistics only for an interval of size « 1 / . Assuming the population is sampled 

at an average rate / = ^ , the number of past statistics that need to be accumulated should be 
P 

Note that the adaptation step does not necessarily have to occur on every iteration. 

9. In addition to estimating the size of the audience we provide a method for dynamically 

estimating an upper bound for the audience size. This is done in the following way: given the 
number of received feedback messages r(t x ) and a risk parameter € , find the maximum possible 
size of the audience, which can result with probability 1 - s in r(t x ) feedback messages. Using 
Bayes theorem and making a Poisson approximation of the binominal probability distribution 
function, it can be shown that the conditional probability of the size of the audience exceeding a 
certain value N max , given observation r(t t ) , is given by 

Pr(AT(/,) > N msx | r(f, )) oc Pg(r(f, ) + l,iW max ) 
where Pg is the incomplete gamma function. 

From this the maximum possible size ^ max (^) is obtained by solving (using a version of the 
Newton-Raphson iteration) 

where Pg is the incomplete gamma function. 

10. This estimate ^ max (//) is then filtered, in the same manner as described in step (7), to 
provide a filtered estimate ^ max (^) of the upper bound of the audience size, using equation (10): 

#max(',) = t K*t -O)^max(O) = ^ " ^{tj)^^ -f y )) (10) 

j=i y=i 
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In this version, the parameters used are those used in Step 7 (and adapted at 8). 



1 1 . This estimate JV max (f, ) is then used to forecast the maximum audience size at the next 
round as follows: 

'/ ~'i-l 

A, A 

^max (',+1 ) = ^ (r/)+ 2 ^ max(/M) otherwise (11) 



12. Using this forecast the sampling probability P(t M ) is calculated from Equation (1) and a 
new feedback request, containing P(t i+l ) is sent to receivers. That is, the above steps are 
1 0 repeated from Step (3). Once a desired number of measurements have been collected, this iteration 
ceases at Step 13. 

Some optional modifications and additional steps will now be described: 

A. The filtering at Step 7 is shown above as being performed whilst measurement is 
continuing, which can be advantageous where measurements are needed in near-real time so that 

15 the filtered results N(t) are available while the measurement process is continuing. However, 

performing this filtering offline as described above can be advantageous in that the filter then has 
access to all the data. In this case the filtering 7 (and adaptation 8) occurs after exit from the 
iteration. However the filtering at Step 10 of the upper bound N max necessarily must remain 
within the loop and hence adaptation must also occur within the loop. In this case it becomes 

20 possible to use a non-causal filter; if this is done, the filter kernel should be modified to 
accommodate negative values of (t r tj) by using, instead of Equation (4), 

Kt) = ^ e -m (12). 
V J 2AJ3 



B. Increasing the robustness of estimation algorithm against network losses 

25 If the network is lossy, some of the requests for feedback can be lost before they reach the 
receivers. Also it can happen that some of feedback messages from receivers do not arrive at the 
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sender. The maximum-likelihood estimate of the audience size (Equation 2) is obtained under the 
assumption that there is no loss in the networks such that all receivers respond to a request for 
feedback with equal probabilities P . 

This method provides a method for taking into account, in an average way, the effect of losses in 
estimating the audience size. 

If the probability of loss at a receiver is qj (for receiver j\ then the probability that a feedback 

message from this receiver reaches the sender is no longer P but would be P } = P(l - q } ) . We 

take this effect into account in our estimation procedure in the following way. We assume that each 
receiver measures its own loss probability (the receivers can do this, for example, by counting the 
number of packets that have not arrived from each multicast group they belong to by looking at 
packet sequence). During feedback collection those receivers whose response is sampled send this 
measurement back to the sender. From this the sender estimates the average packet loss q and 

takes this into account by replacing P with (1 - qf P in the maximum-likelihood estimate of the 
audience size. The corrected estimate for the audience size is then obtained from 



Where the term in the bracket is a correction to the estimated audience size, resulting from network 
losses. This modification is implemented by using Equation (13) instead of Equation (2). 

C. Relaxing the feedback implosion limit 

The implosion of feedback occurs when the number of feedback messages that simultaneously 
reach the sender exceeds r max . In addition to choosing the value of response probability P such 

that the chance of implosion is below a certain threshold, the sender can further reduce the 
possibility of implosion by stretching the interval over which it receives the responses. This can be 
achieved by sending together with the parameter P a second parameter S . The feedback 
procedure is then modified as follows: 

Each receiver selects a uniform random number X and decides to send a feedback only if X < P . 
After making the decision it selects a random number s which is uniformly distributed in the 
interval [0,25] and waits for a time s before sending its feedback. The net effect of this algorithm 
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is to spread the feedback from receivers over an interval S so that the average number of feedback 

messages that are sent per unit time is given by and feedback implosion can be avoided if 

1 + S 

r < (1 + 5)r max . So the implosion limit is effectively (1 + S)r maK , instead of r max . In Step (2), 
Equation (1) is then modified by inserting (1 + S> max in place of r max and so that the new limit is 

then used to calculate P. The value of P calculated from this will be larger than the value calculated 
using r max (we know this from the shape of gamma function), and therefore more feedbacks will be 
generated per round and the accuracy of population estimation is improved. 

The above-described method deals with end-to-end methods where audience estimation can be 
done at the application level without any assistance from network routers, and with very large- 
scale Multicast scenarios in mind. 

It alleviates some of the problems discussed earlier by using an adaptive method for sampling 
feedback from receivers and a method for adapting the filtering of statistical errors to dynamic 
variations of the audience size. 

The adaptive sampling method minimises the risk of feedback implosion and at the same time 
helps to ensure that the sender receives the maximum possible number of feedback messages. The 
adaptive filtering adjusts dynamically to the pattern of the audience's size variation in time in order 
to maximise the signal to noise ratio of the estimate. Furthermore, we have described a procedure 
for improving the robustness of the estimation method to large packet losses in the network and a 
method for relaxing the implosion limit using random timers. 



